Each score pertains to the combined test set of the language, without distinguishing individual treebanks and the enhancement types they annotate. The last line shows the macro-average over languages.
Language | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS |
Arabic | 99.98 | 97.80 | 80.05 | 4.58 | 0.00 | 37.25 | 0.00 | 0.00 | 32.46 | 2.04 | 2.43 | 0.03 | 0.00 | 65.18 | 63.41 |
Bulgarian | 99.93 | 99.93 | 97.14 | 0.00 | 0.00 | 35.96 | 0.00 | 0.01 | 10.53 | 1.11 | 1.38 | 0.00 | 0.00 | 79.41 | 78.67 |
Czech | 99.90 | 99.90 | 94.11 | 0.01 | 0.00 | 24.21 | 0.00 | 0.00 | 13.16 | 1.36 | 1.65 | 0.00 | 0.00 | 76.55 | 75.43 |
Dutch | 99.87 | 99.87 | 72.55 | 0.38 | 0.00 | 43.92 | 0.00 | 0.00 | 9.23 | 0.46 | 0.59 | 0.00 | 0.00 | 71.45 | 70.94 |
English | 99.36 | 99.36 | 86.56 | 0.31 | 0.00 | 33.13 | 0.00 | 0.00 | 7.66 | 0.94 | 1.19 | 0.04 | 0.00 | 72.96 | 72.34 |
Estonian | 99.74 | 99.74 | 91.79 | 0.12 | 0.04 | 34.57 | 0.00 | 0.00 | 11.53 | 0.73 | 0.86 | 0.00 | 0.00 | 75.63 | 74.91 |
Finnish | 99.69 | 99.67 | 92.27 | 0.09 | 0.00 | 30.05 | 0.00 | 0.01 | 13.11 | 0.66 | 0.77 | 0.00 | 0.00 | 76.92 | 75.99 |
French | 99.81 | 99.71 | 96.14 | 0.81 | 0.00 | 34.48 | 0.00 | 0.35 | 13.88 | 2.37 | 3.11 | 0.08 | 0.00 | 78.16 | 76.99 |
Italian | 99.91 | 99.76 | 98.76 | 0.12 | 0.02 | 38.83 | 0.02 | 0.00 | 10.16 | 0.58 | 0.77 | 0.00 | 0.00 | 73.62 | 73.08 |
Latvian | 99.82 | 99.82 | 99.01 | 0.57 | 0.00 | 35.64 | 0.00 | 0.03 | 10.36 | 0.97 | 1.17 | 0.00 | 0.00 | 78.26 | 77.77 |
Lithuanian | 99.87 | 99.87 | 88.79 | 1.50 | 0.00 | 30.11 | 0.00 | 0.00 | 10.75 | 1.17 | 1.40 | 0.00 | 0.00 | 69.23 | 66.85 |
Polish | 98.08 | 98.78 | 90.49 | 0.45 | 0.00 | 34.15 | 0.00 | 0.00 | 18.08 | 1.42 | 1.74 | 0.00 | 0.00 | 75.07 | 71.01 |
Russian | 99.57 | 99.57 | 98.86 | 0.02 | 0.00 | 36.32 | 0.00 | 0.00 | 13.76 | 0.51 | 0.63 | 0.00 | 0.00 | 78.62 | 78.26 |
Slovak | 99.97 | 99.97 | 90.93 | 0.92 | 0.00 | 22.68 | 0.00 | 0.00 | 13.07 | 1.35 | 1.61 | 0.00 | 0.00 | 75.49 | 73.14 |
Swedish | 99.45 | 99.45 | 94.32 | 0.00 | 0.00 | 33.57 | 0.00 | 0.00 | 8.30 | 0.20 | 0.24 | 0.00 | 0.00 | 70.77 | 69.60 |
Tamil | 99.58 | 91.42 | 95.08 | 0.05 | 0.00 | 26.64 | 0.00 | 0.00 | 11.09 | 0.00 | 0.00 | 0.00 | 0.00 | 50.18 | 48.20 |
Ukrainian | 99.81 | 99.79 | 96.65 | 0.70 | 0.78 | 26.81 | 0.00 | 0.02 | 13.98 | 0.94 | 1.15 | 0.00 | 0.00 | 73.74 | 72.98 |
Average | 99.67 | 99.08 | 91.97 | 0.63 | 0.05 | 32.84 | 0.00 | 0.02 | 13.01 | 0.99 | 1.22 | 0.01 | 0.00 | 73.01 | 71.74 |
The system output for each language was split into parts corresponding to individual source treebanks. The scores then ignore errors in enhancement types for which the treebank lacks gold-standard annotation. The column LAvgELAS shows the qualitative ELAS averaged over treebanks of the same language; the final average in bold is averaged over languages rather than treebanks. For comparison, the last column then shows the coarse ELAS F1 for the given language.
Treebank | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS | Enhancements | LAvgELAS | cf. |
Arabic-PADT | 99.98 | 97.80 | 80.05 | 4.58 | 0.00 | 37.25 | 0.00 | 0.00 | 32.46 | 2.04 | 2.43 | 0.03 | 0.00 | 65.17 | 63.41 | (no xsubj) | 63.41 | 63.41 |
Bulgarian-BTB | 99.93 | 99.93 | 97.14 | 0.00 | 0.00 | 35.96 | 0.00 | 0.01 | 10.53 | 1.11 | 1.38 | 0.00 | 0.00 | 79.41 | 78.67 | 78.67 | 78.67 | |
Czech-FicTree | 99.98 | 99.93 | 92.29 | 0.02 | 0.00 | 32.18 | 0.00 | 0.00 | 12.31 | 2.24 | 2.82 | 0.00 | 0.00 | 79.97 | 78.72 | 75.01 | 75.43 | |
Czech-CAC | 99.99 | 99.98 | 97.12 | 0.00 | 0.00 | 22.84 | 0.00 | 0.00 | 11.21 | 1.14 | 1.38 | 0.00 | 0.00 | 76.76 | 75.76 | 75.01 | 75.43 | |
Czech-PDT | 99.97 | 99.97 | 93.98 | 0.01 | 0.00 | 23.75 | 0.00 | 0.00 | 13.46 | 1.38 | 1.67 | 0.00 | 0.00 | 76.76 | 75.70 | 75.01 | 75.43 | |
Czech-PUD | 99.15 | 99.15 | 95.85 | 0.00 | 0.00 | 22.17 | 0.00 | 0.01 | 12.25 | 0.49 | 0.60 | 0.00 | 0.00 | 71.54 | 69.87 | (no codepend) | 75.01 | 75.43 |
Dutch-Alpino | 99.96 | 99.96 | 89.98 | 0.39 | 0.00 | 40.72 | 0.00 | 0.00 | 8.07 | 0.12 | 0.15 | 0.00 | 0.00 | 74.12 | 73.54 | 71.00 | 70.94 | |
Dutch-LassySmall | 99.78 | 99.78 | 58.51 | 0.36 | 0.00 | 46.99 | 0.00 | 0.00 | 10.33 | 0.80 | 1.01 | 0.00 | 0.00 | 68.90 | 68.45 | 71.00 | 70.94 | |
English-EWT | 99.00 | 99.00 | 81.16 | 0.51 | 0.00 | 33.25 | 0.00 | 0.00 | 9.08 | 1.71 | 2.13 | 0.07 | 0.00 | 73.76 | 73.22 | 72.28 | 72.34 | |
English-PUD | 99.78 | 99.78 | 97.22 | 0.08 | 0.00 | 32.99 | 0.00 | 0.00 | 5.99 | 0.04 | 0.05 | 0.00 | 0.00 | 72.06 | 71.35 | 72.28 | 72.34 | |
Estonian-EDT | 99.96 | 99.96 | 93.32 | 0.14 | 0.04 | 34.42 | 0.00 | 0.00 | 11.55 | 0.75 | 0.89 | 0.00 | 0.00 | 76.56 | 75.97 | (no xsubj) | 72.95 | 74.91 |
Estonian-EWT | 98.65 | 98.65 | 82.67 | 0.00 | 0.06 | 35.30 | 0.00 | 0.00 | 11.45 | 0.61 | 0.73 | 0.00 | 0.00 | 71.29 | 69.93 | (no codepend, no xsubj) | 72.95 | 74.91 |
Finnish-TDT | 99.77 | 99.73 | 93.05 | 0.10 | 0.00 | 31.02 | 0.00 | 0.00 | 12.89 | 0.93 | 1.10 | 0.00 | 0.00 | 78.40 | 77.57 | 75.66 | 75.99 | |
Finnish-PUD | 99.58 | 99.58 | 91.09 | 0.08 | 0.00 | 28.77 | 0.00 | 0.01 | 13.39 | 0.29 | 0.34 | 0.00 | 0.00 | 74.80 | 73.74 | (no codepend, no xsubj) | 75.66 | 75.99 |
French-Sequoia | 99.58 | 99.37 | 75.42 | 0.33 | 0.00 | 36.75 | 0.00 | 0.01 | 10.48 | 0.56 | 0.73 | 0.05 | 0.00 | 80.17 | 79.90 | (no gapping, relcl, case) | 78.12 | 76.99 |
French-FQB | 99.91 | 99.85 | 99.93 | 1.01 | 0.00 | 33.54 | 0.00 | 0.48 | 15.30 | 3.13 | 4.10 | 0.09 | 0.00 | 77.01 | 76.33 | (no gapping, relcl, case) | 78.12 | 76.99 |
Italian-ISDT | 99.91 | 99.76 | 98.76 | 0.12 | 0.02 | 38.83 | 0.02 | 0.00 | 10.16 | 0.58 | 0.77 | 0.00 | 0.00 | 73.62 | 73.08 | 73.08 | 73.08 | |
Latvian-LVTB | 99.82 | 99.82 | 99.01 | 0.57 | 0.00 | 35.64 | 0.00 | 0.03 | 10.36 | 0.97 | 1.17 | 0.00 | 0.00 | 78.26 | 77.77 | 77.77 | 77.77 | |
Lithuanian-ALKSNIS | 99.87 | 99.87 | 88.79 | 1.50 | 0.00 | 30.11 | 0.00 | 0.00 | 10.75 | 1.17 | 1.40 | 0.00 | 0.00 | 69.23 | 66.85 | 66.85 | 66.85 | |
Polish-LFG | 99.95 | 99.95 | 99.83 | 0.00 | 0.00 | 35.45 | 0.00 | 0.00 | 18.06 | 3.02 | 3.71 | 0.00 | 0.00 | 82.07 | 77.07 | (no gapping) | 71.96 | 71.01 |
Polish-PDB | 97.73 | 98.87 | 85.71 | 0.66 | 0.00 | 35.01 | 0.00 | 0.00 | 17.69 | 1.22 | 1.49 | 0.00 | 0.00 | 74.19 | 70.13 | 71.96 | 71.01 | |
Polish-PUD | 97.39 | 97.78 | 85.62 | 0.39 | 0.00 | 31.64 | 0.00 | 0.01 | 18.80 | 0.66 | 0.79 | 0.00 | 0.00 | 72.15 | 68.69 | 71.96 | 71.01 | |
Russian-SynTagRus | 99.57 | 99.57 | 98.86 | 0.02 | 0.00 | 36.32 | 0.00 | 0.00 | 13.76 | 0.51 | 0.63 | 0.00 | 0.00 | 78.62 | 78.26 | 78.26 | 78.26 | |
Slovak-SNK | 99.97 | 99.97 | 90.93 | 0.92 | 0.00 | 22.68 | 0.00 | 0.00 | 13.07 | 1.35 | 1.61 | 0.00 | 0.00 | 75.49 | 73.14 | 73.14 | 73.14 | |
Swedish-Talbanken | 99.96 | 99.96 | 98.85 | 0.00 | 0.00 | 34.22 | 0.00 | 0.00 | 8.73 | 0.34 | 0.42 | 0.00 | 0.00 | 74.21 | 73.10 | 69.50 | 69.60 | |
Swedish-PUD | 98.89 | 98.89 | 88.96 | 0.00 | 0.00 | 32.88 | 0.00 | 0.01 | 7.84 | 0.04 | 0.05 | 0.00 | 0.00 | 67.13 | 65.90 | 69.50 | 69.60 | |
Tamil-TTB | 99.58 | 91.42 | 95.08 | 0.05 | 0.00 | 26.64 | 0.00 | 0.00 | 11.09 | 0.00 | 0.00 | 0.00 | 0.00 | 50.17 | 48.19 | (no gapping, xsubj, relcl) | 48.19 | 48.20 |
Ukrainian-IU | 99.81 | 99.79 | 96.65 | 0.70 | 0.78 | 26.81 | 0.00 | 0.02 | 13.98 | 0.94 | 1.15 | 0.00 | 0.00 | 73.74 | 72.98 | 72.98 | 72.98 | |
Average | 99.55 | 99.22 | 90.92 | 0.45 | 0.03 | 32.65 | 0.00 | 0.02 | 12.68 | 1.00 | 1.24 | 0.01 | 0.00 | 73.77 | 72.40 | 71.70 |